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Abstract. 


This paper illustrates how a sender can encode binary data words so that the 
data words can be sent over a weak noisy communication channel and a 
receiver can detect the correct data words. No abstract mathematical equations 
are used; just two numerical examples. The first example is a simple example. 
The second example is the encoding method used on Mariner 9 spacecraft to 
transmit pictures of the Martian surface as it orbited Mars. The Hadamard linear 
block code is used for both examples. 


Introduction. 


While doing research to reverse engineer the HF digital mode called Olivia, | 
developed two numerical examples (no strange mathematical symbols and 
abstract formulas.) that can explain to Radio Amateurs about linear Forward 
Error Correction (FEC) techniques for sending binary symbols over a radio link. 
Mathematicians and Communications Engineers may look at my examples with 
some disdain but my examples do illustrates how FEC works. 


This paper covers the following: 

¢ Ashort introduction of the various methods of Forward Error Correction for 
communications links. 

¢ Background information about the Hadamard linear block code. 

¢ Asimple example of a “Covert Number Station” broadcasting random 
numbers. 

¢ Anon mathematical method for constructing a Hadamard matrix used for 
encoding and decoding Forward Error Correction Code Words. 

¢ Background information and numerical examples for the code used on the 
Mariner 9 spacecraft. Mariner 9 mission was to orbit Mars and transmit 
pictures back to Earth. Forward Error Correction was used to send pictures of 
the Martian surface back to earth on a weak and noisy communication link. 

¢ Bit Error Rate determination using Forward Error Correction. 


Introduction to Forward Error Correction. 


According to the BitcoinWiki, Forward Error Correction (FEC) is a technique used 
for controlling errors in data transmission over unreliable or noisy communication 
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channels. The central idea is that the sender encodes the message in a 
redundant way. The redundancy allows the receiver to detect a limited number of 
errors that may occur anywhere in the message. FEC gives the receiver the 
ability to correct errors without needing a reverse channel to request 
retransmission of data, but at the cost of a fixed, higher forward channel 
bandwidth. FEC is therefore applied in situations where retransmissions are 
costly or impossible, such as one-way communication links and when 
transmitting to multiple receivers in multicast. The maximum number of errors 
that can be corrected is determined by the design of the FEC code, so different 
forward error correcting codes are suitable for different conditions |). 


A simplistic example of FEC is to transmit each data bit 3 times, which is known 
as a (3,1) repetition code. This allows an error in any one of the three samples to 
be corrected by "majority vote". Though simple to implement and widely used, 
this triple modular redundancy is a relatively inefficient FEC. 


The two main categories of FEC codes are block codes and convolutional codes. 


There are several linear block codes such as Hamming codes, Reed-Solomon 
codes, Hadamard codes, Expander codes, Golay codes, and Reed-Muller codes. 


In convolutional codes, the message comprises of data streams of arbitrary 
length and a sequence of output bits are generated by the sliding application of 
Boolean functions to the data stream. The convolutional codes can operate on a 
continuous string of data, whereas block codes operated on words. Convolutional 
codes also have memory—the behavior of the code depends on previous data [?!. 


Hadamard Code Background. 


In this paper, | am limiting my discussion and examples to the Hadamard linear 
block code. The Hadamard code is also known under the names Walsh code, 
Walsh family, and Walsh—Hadamard code in recognition of the American 
mathematician Joseph Leonard Walsh !8]. Hadamard matrices are simple matrix 
structures and are used to generate the Hadamard code. 


A Hadamard matrix is square, have entries +1 or —1 and have orthogonal row 
vectors and orthogonal column vectors. Figure 1 shows an 8 X 8 Hadamard 
matrix. Figure 2 is also an 8X8 Hadamard Matrix. The point | am trying to make 
is that you do not use the mathematical format for FEC. 
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Figure 2. Hadamard 
Matrix using Black and 
White Colors 


Figure 1. 8X8 Hadamard Matrix 
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Hadamard matrices have been actively studied by mathematicians for about a 
century and half and new uses are still being discovered. At the end of the 
referenced web page [°! is a list of practical applications for Hadamard matrices 
including an amateur radio protocol. 


The Hadamard code is also used for code division multiple access (CDMA). In 
CDMA, the Hadamard code is referred to as Walsh Code, and is used to define 
individual communication channels. Each user will use a different Code Word, to 
modulate their signal. Because Walsh Code Words are mathematically 
orthogonal, a Walsh-encoded signal appears as random noise to a CDMA 
capable mobile terminal (cell phone), unless that terminal uses the same Code 
Word as the one used to encode the incoming signal !9I. 


Simple Example. 


My simple example is not a very practical example because it corrects only one 
error. This example is of a covert number station that needs to broadcast what 
appears to be random numbers. This number station broadcasts only integers in 
the range of 0 to 7 using binary numbers. For this simple example, the broadcast 
station located in Cuba uses two different drum sounds in some music that starts 
the next segment of a radio program. A high drum sound Is a one and a low 
sound is a drum zero. 
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Each Data Word contains three bits that is one number in the range of 0 through 
7. To send eight different Data Words using the Hadamard Code, you need 8 
different Code Words. An 8 X 8 Hadamard Matrix has 8 rows and each row is a 
Code Word. At this point in my simple example, | am not going to show how to 
make a Hadamard Matrix. Later, | will show a non mathematical way of creating 
a Hadamard Matrix of the size required for the 


Mariner 9 mission. | Table 1. Encode Table | 


Since computers use 1’s and 0’s, | am going to Ese eee Ets) 

- : : Value matrix 
change the -1’s to 0’s for the simple example 
Hadamard matrix as shown in Table 1. To the right ss i Be Is 


of the matrix are the Data Words and to the left are 
the Data Values. Instead of sending 011 for the 10101010 
number 3, after Hadamard encoding the number 3 11001100 


becomes 10011001. 
10011001 


11110000 
| Table 2. Decode Table | 
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As a side note, | did not need to assign the top row 0 and the bottom row 7. Any 
assignment would work as long as the receive stations know the assignment. 


Using the Table 1 Encode Code Table, the covert number station is going to 
broadcast the Data Value 3, for four consecutive times. The Data Word that is 
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being encoded four times is 011 and the Transmitted Code Word that is being 
sent four time is 10011001. 


The receive site has some interference and the agent in the field receives the 
four Code Words with some errors in the Code Words. With the help of Table 2, 
the field agent can decode the message. (Figure 3 defines the column headings 
used in Table 2.) The field agent needs four digits to identify the mission that are 
listed in the field agent mission book — the mission number book is not shown in 


this paper because it is Top Secret. The mission for this broadcast is number 


3333. 


Figure 3. Column Headings Definitions for 
Table 2 


Send Data Value = 3 and Data Word = 011 
Transmitted Data Code Word = 10011001 
RCWx = Received Code Word with x errors 
RCWO = 10011001 (0 error.) 


RCW1 = 10001001 (1 error. red indicates 
received bit error) 
RCW2 = 10000001 (2 errors. red indicates 


The receive decode 
Hadamard matrix has the 
same values as the 
transmit encode 
Hadamard matrix. A 
simple scoring method 
identifies the Transmitted 
Code Word. The 
Received Code Word is 
given one point for each 
time it has the same bit 
value in the same position 


received bit error) 
RCW3 = 10000101 (3 errors. red indicates 
received bit error) 


as a row in the Hadamard 
Matrix. The row with the 
highest score identifies 
the data value. 


The first Received Code Word (RCWO) has zero bit errors and has a perfect 
score for the Code Word that corresponds to the Data Value of 3. Whena 
Received Code Word has a perfect match in the decode table all the other 
Received Code Words have a score that is equal to the distant value that a row 
in the Hadamard matrix has to all the other rows in the Hadamard matrix. The 
distant value is simply the number of bits that one row has that are different than 
any other row in the Hadamard Matrix. In standard coding theory notation for 
block codes, my simple example Hadamard code is a [8,3,4] where the 8 is block 
length ( the number of bits in a Hadamard row), the 3 is the message length (the 
number of bits in the Data Word) and the 4 is the distance. The Mariner 9 code 
that is discussed later has a large block length compared to the message length 
that allows many bit errors in the Received Code Word. 
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The second Received Code Word (RCW1) has one bit error. My simple example 
using a Hadamard code [8,3,4] can only correct one bit error. The highest score 
in the decode table is for the Received Code Word for the Data Value of 3. 
Based on the score in the decode table, the field agent knows that the Code 
Word has one error and the Data Value is 3. 


The third Received Code Word (RCW2) has two bit errors. Based on the score 
for RCW2 in the decode table, the field agent knows that RCW2 has two bit 
errors but does not know the Data Value. The field agent, who is in Oregon, 
checks the mission book and see that all missions that have the first three 
numbers of 335 and 336 are in Chicago. Using deduction, the field agent knows 
that the first three numbers in his mission are 333. 


The fourth Received Code Word (RCWS) has three bit errors. The field agent 
does not know the RCWS3 has three bit errors and using the scoring in the 
decode table the agent concludes the RCW3 has one bit error and he prepares 
to complete mission number 3335 instead of mission number 3333. FEC does 
have limitations. 


How to construct a Hadamard Matrix. 


A Hadamard matrix H of order n is ann x n matrix. My simple example used a 
Hadamard matrix of order 8 and is an 8 X 8 matrix. A Hadamard matrix can exist 
only if nis a multiple of 4. A2 X 2 Hadamard matrix does exist and is a start 
point for building larger Hadamard matrices. 


Figure 4 shows Hadamard matrices of order 2, 4, 8, and 16. The subscript on 
the H indicates the order of the Hadamard matrix. In the larger matrices, 
construction lines divide a matrix in 4 quadrants. 


A Hadamard order 4 matrix can be made from the Hadamard order 2 matrix. To 
construct the Hadamard matrix of order 4, make a new Hadamard matrix of order 
2 by changing the sign of every entry in the Hadamard order 2 matrix. Place that 
new Hadamard order 2 matrix in the lower right quadrant of the order 4 matrix. 
Copy the original order 2 matrix in the other 3 quadrants of the order 4 matrix. 
Similarly, a Hadamard order 8 matrix can be made from the Hadamard order 4 
matrix and a Hadamard order 16 matrix can be made from the Hadamard order 8 
matrix. A large Hadamard matrix can be made using this technique. There are 
easier ways to make Hadamard matrices using mathematics. 
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Figure 4. Hadamard Matrices Construction 
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Figure 2 is from reference 41 
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Mariner 9 Background. 


In 1971, the Mars Mariner 9 Spacecraft was the first man-made object to orbit a 
different planet and send back pictures of Mars that was 84 million miles from 
earth using a 20-watt transmitter. The pictures were black and white. Each 
Martian photograph required 4.5 million bits. The 4.5 million bits were split into 6 
bit Data Words. Using 6 bits per Data Word, 64 different Data Words were 
created [51.18], 


Because of the weak signal from Mariner 9, the maximum useful data length of a 
Data Word with forward error correction was about 30 bits. The 5-repeat code 
was a possibility, having the advantage that it is very easy to implement, but it is 
only a capability of correcting 2 errors in an encoded word. To send a 6 bit Data 
Word with 5-repeat code becomes a 30 bits per Transmitted Code Word. (For 
sending a six bit Data Word like 010101, the data stream with 5-repeat code 
becomes 000001111100000111110000011111.) The Hadamard code was chosen 
for Mariner 9 because encoding a 6 bit Data Word into a 32 bit Transmitted Code 
Word gives a capability of correcting 7 errors at the received location (6. 


A Hadamard order 5 matrix has 32 Code Words and has 32 bits per Code Word. 
The 32 bits per Code Word meets the Mariner 9 requirement but a total of 64 
Code Words are required. A Hadamard order 6 matrix has 64 Code Words but 
the Mariner 9 communication link cannot support sending 64 bit Code Words. 
The solution is to use an augmented Hadamard code. 


An augmented Hadamard code for Mariner 9 uses two different Hadamard order 
5 matrices stacked together such that it becomes one matrix with 64 rows and 32 
columns. The second matrix has 0’s where the first matrix has 1’s and the 
second matrix has 1’s where the first matrix has 0’s. All the rows in the 
augmented Hadamard code matrix of order n are different and will have the 
same distant value as the standard Hadamard code matrix of order n. In 
standard coding theory notation for block codes, the Mariner 9 augmented 
Hadamard code is [82,6,16] and the standard Hadamard code matrix of order 5 
is [32,5,16]. Table 3 contains the augmented Hadamard code matrix that | am 
going to show FEC capability for Mariner 9. Table 3 also has the scores for 
Received Code Words. The Mariner 9 Code Words discussion is later in this 
paper. 
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Now before | proceed to show the decode capability of the [32,6,16], | need to 
comment about the design of Mariner 9. Processors and memory was not that 
great during the 1960s. The central processor for Mariner had a memory of 512 
words [5]. Mariner 9 could not store 64, 32-bit Code Words. Mariner 9 did use a 
hardware design that was more economical in terms of speed, space, and 
weight. The hardware designed calculated a Transmitted Code Word from a Data 
Word rather than read it out of a stored array [7]. Amateur Radio HF modes that 
use Hadamard Code Words are not read out of a stored array but use a software 
program that calculates a Transmitted Code Word from each Data Word. 


The earth receiving station for Mariner 9 required a fast decoding algorithm. The 
decision to use the FEC Hadamard code was based primarily on the decoding 
algorithm. A NASA engineer with the last name of Green designed what was 
called “The Green Machine”. “The Green Machine” used a Fast Fourier 
Transform to calculate the Data Words from the Received Code Words "1. 


Using Table Look-Up for Mariner 9 Code Words. 


The earlier simple example had a small Code Word look-up table because the 
simple example had only 8 Data Words. The Mariner 9 has 64 Data Words and 
uses an augmented Hadamard code that requires two 32 X 32 Hadamard 
matrices. | copied the Mariner 9 Data Word to Code Word assignment from 
reference [8]. | added the score columns for two different Received Code Words 
for the table shown in Table 3. | had to use two pages for Table 3. Table 3a 
contains the Received Code Word assignments for the Data Words with value of 
1 for the most significant bit. Table 3b contains the Received Code Word 
assignments for the Data Words with value of 0 for the most significant bit. 


Figure 5 has the Column Headings Definitions for Table 3. Red bit values in the 
Received Code Words are bit errors. The values in the table that are blue 
indicates the Data Word with the most significant bit value of 1 and green 
indicates the Data Word with the most significant bit value of 0. 


The Table 3 shows that the highest score indicates the correct Data Word for a 
Received Code Word that has less than 8 bit errors. If a Received Code Word 
has 8 or more bit errors, the correct Data Word cannot be determined. Every 
entry in a column does not need to be completed for determining the correct 
Received Code Word. A score of greater than 24 determines the correct 
Received Code Word. For example, if a cell in table 3 has a score of 25 then no 
cell in that column will have a score greater than or equal to 25. 
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Figure 5. Column Headings Definitions for Table 3 
Send Data Words alternates between 100011 and 000011 


Transmitted Code Words alternates between: 
10101010010101011010101001010101 
00000000111111110000000011111111 

First Received Code Word is 1E0 and last is O0E8 


{ 
EO = O errors for Received Code Word that has 1 as most significant bit 


0 
EO = 0 errors for Received Code Word that has 0 as most significant bit 


The number above E indicates the value for the most significant bit and 
the number following E indicates the number of errors in the Received 
Code Word. 


Received Code Words. Red bit values are bit errors. 
1EO0 = 10101010010101011010101001010101 
OEO 00000000111111110000000011111111 
1EL 10101010010101011010101001010100 
OE2 00000000111111110000000011111100 
1E3 = 10101010010101011010101001010010 
OE4 00000000111111110000000011110000 
1E5 10101010010101011010101001001010 
OE6 = 00000000111111110000000011000000 
LE? 10101010010101011010101000101010 
0OE8 00000000111111110000000000000000 


Note: The position of any bit error does not affect the score 


Table 99a. Score for Received Code Words 


Data Code Word ee Os sells Ol lO) lien Ore) ea 
Word EO |EO | E1/|E2/E3 E4/E5|E6 | E7|E8 


111111 11111111111111111111111111111111 
100000 10101010101010101010101010101010 
110000 11001100110011001100110011001100 
101111 10011001100110011001100110011001 
111000 11110000111100001111000011110000 
100111 10100101101001011010010110100101 
110111 11000011110000111100001111000011 
101000 10010110100101101001011010010110 
111100 = 11111111000000001111111100000000 
100011 | 10101010010101011010101001010101 
110011 11001100001100111100110000110011 
101100  10011001011001101001100101100110 
111011  11110000000011111111000000001111 
100100 10100101010110101010010101011010 
110100 11000011001111001100001100111100 
101011 10010110011010011001011001101001 
111110 = 11111111111111110000000000000000 
100001  10101010101010100101010101010101 
110001 11001100110011000011001100110011 
101110  10011001100110010110011001100110 
111001  11110000111100000000111100001111 
100110 10100101101001010101101001011010 
110110 11000011110000110011110000111100 
101001  10010110100101100110100101101001 
111101  11111111000000000000000011111111 
100010 10101010010101010101010110101010 
110010 11001100001100110011001111001100 
101101  10011001011001100110011010011001 
111010  11110000000011110000111111110000 
100101 10100101010110100101101010100101 
110101 11000011001111000011110011000011 


101010 10010110011010010110100110010110 
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Table 99b. Score for Received Code Words 


Data Code Word Ae OL ee Oa ea Oey) | sO tl aa0 
Word EO |EO E1 E2'E3|E4 E5/|E6 E7 E8 


010101 | 01101001100101101001011001101001 
001010 | 00111100110000111100001100111100 
011010 | 01011010101001011010010101011010 
000101 | 00001111111100001111000000001111 
010010 | 01100110100110011001100101100110 
001101 | 00110011110011001100110000110011 
011101 | 01010101101010101010101001010101 
000010 | 00000000111111111111111100000000 
010110 | 01101001011010011001011010010110 
001001 | 00111100001111001100001111000011 
011001 | 01011010010110101010010110100101 
000110 | 00001111000011111111000011110000 
010001 | 01100110011001101001100110011001 
001110 | 00110011001100111100110011001100 
011110 | 01010101010101011010101010101010 
000001 | 00000000000000001111111111111111 
010100 | 01101001100101100110100110010110 
001011 | 00111100110000110011110011000011 
011011 | 01011010101001010101101010100101 
000100 | 00001111111100000000111111110000 
010011 | 01100110100110010110011010011001 
001100 | 00110011110011000011001111001100 
011110 | 01010101101010100101010110101010 
010111 | 01101001011010010110100101101001 
001000 | 00111100001111000011110000111100 
011000 | 01011010010110100101101001011010 
000111 | 00001111000011110000111100001111 
010000 | 01100110011001100110011001100110 
001111 | 00110011001100110011001100110011 
011111 | 01010101010101010101010101010101 


000000 | 00000000000000000000000000000000 
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Bit Error Rate (BER). 


The average Bit Error Rate (BER) can be calculated for FEC linear block codes 
by using the average number of bit correction required for each Received Code 
Word. For the table look-up method, the number of errors for the Received Code 
Word is the difference between the perfect score and the actual score. For the 
words in Table 3 that have the high score, there are 10, 32 bit Received Code 
Words and the average BER is: 


Average BER = (0+0+1+2+3+4+5+6+7+8)/(10*32) = 36/320 = .11=11% 


| used the word with 8 errors because the Mariner 9 FEC can detect 8 bit errors 
but it can correct only 7 bit errors. 


Summary. 


The table look-up method is generally not used for Hadamard FEC encoding 
and decoding Data Words. Encoding and decoding can be quickly done using 
math and a small computer program. The Mariner 9 augmented Hadamard 
code is [32,6,16], where the 32 is block length ( the number of bits in a 
Hadamard row), the 6 is the message length (the number of bits in the Data 
Word) and the 16 is the distance. For FEC linear block codes, the maximum 
number of errors that can be corrected is determined by half the distance minus 
1. The maximum number of errors that can be detected is half the distance. 
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